Papers by Juan Manuel Pérez
RoBERTuito: a pre-trained language model for social media text in Spanish (2022.lrec-1)
Copied to clipboard
| Challenge: | Pre-trained language models have been used in many natural language processing tasks . some domain-specific models have shown to improve performance in some domains . however, for languages other than English, such models are not widely available . |
| Approach: | They present a pre-trained language model for user-generated text in Spanish . it is based on 500 million tweets and has some cross-lingual abilities . |
| Outcome: | The model outperforms models trained on over 500 million tweets on a benchmark in spanish and english. |
MessIRve: A Large-Scale Spanish Information Retrieval Dataset (2025.emnlp-main)
Copied to clipboard
Francisco Valentini, Viviana Cotik, Damián Furman, Ivan Bercovich, Edgar Altszyler, Juan Manuel Pérez
| Challenge: | Information retrieval (IR) is the task of finding relevant documents in response to a user query. |
| Approach: | They propose a large-scale Spanish IR dataset with almost 700,000 queries from Google’s autocomplete API and relevant documents sourced from Wikipedia. |
| Outcome: | The proposed dataset covers a wide variety of topics, unlike smaller datasets. |
Exploring Large Language Models for Hate Speech Detection in Rioplatense Spanish (2025.findings-naacl)
Copied to clipboard
| Challenge: | Hate speech detection deals with many language variants, slang, nuances, and cultural nuances. |
| Approach: | They propose to use large language models to detect hate speech in Rioplatense Spanish . they compare their results to those of a state-of-the-art BERT classifier . |
| Outcome: | The proposed models show lower precision than the state-of-the-art classifier, but are sensitive to highly nuanced cases. |